Automatic Retrieval of Object Interaction Relationships

ABSTRACT

A method for automatically retrieving interaction information between objects, including: with a server, transforming a first image and a second image submitted to said server from a source into first and second sets of parameters, respectively; searching a database for an interaction relationship between the first and second images using the first and second sets of parameters; and returning a representation of the interaction relationship to the source.

BACKGROUND

The present specification relates to the field of object interactions.Specifically, the present specification relates to the field ofprocuring interaction diagrams between various objects.

The interactions between two or more different objects can be many. Theinteractions may range from simple to complicated and can include theinteraction of people with the objects, as well. Understanding theinteractions between various objects can help to understand more abouteach individual object, as well as help to learn more about how theobjects can be used with one another. The interaction relationshipsbetween two or more objects may also be useful in allowing a person toperform a do-it-yourself project.

BRIEF SUMMARY

A method for automatically retrieving interaction information betweenobjects, includes: with a server, transforming a first image and asecond image submitted to said server from a source into first andsecond sets of parameters, respectively; searching a database for aninteraction relationship between the first and second images using thefirst and second sets of parameters; and returning a representation ofthe interaction relationship to the source.

An object interaction relationship procurement system includes a serverconfigured to receive images from an image source, the server comprisingan image-translation program for converting images into correspondingsets of parameters; and a database in communication with the servercomprising a searchable store of object interaction relationships. Theserver is configured to search the database for an object interactionrelationships corresponding to the parameters and return arepresentation of the object interaction relationship to the source.

A computer program product for automatically retrieving interactioninformation between objects includes a computer readable storage mediumhaving computer readable program code embodied therewith. The computerreadable program code includes: computer readable program codeconfigured to transform a first image into a first set of parameters anda second image into a second set of parameters; computer readableprogram code configured to search a database for an interactionrelationship between objects in the first and second images; andcomputer readable program code configured to return a representation ofthe interaction relationship to a source of the first image and thesecond image in an organized format.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The accompanying drawings illustrate various embodiments of theprinciples described herein and are a part of the specification. Theillustrated embodiments are merely examples and do not limit the scopeof the claims.

FIG. 1 is a diagram of an illustrative system for automaticallyretrieving interaction information between objects, according to oneexemplary embodiment of principles described herein.

FIG. 2 is a flowchart showing an illustrative method for automaticallyretrieving interaction information between objects, according to oneexemplary embodiment of principles described herein.

FIG. 3 is a diagram illustrating different image sources, according tovarious exemplary embodiments of principles described herein.

FIG. 4 is a diagram of an illustrative system for retrieving interactionrelationships between objects in images acquired using a mobilecommunication device, according to one exemplary embodiment ofprinciples described herein.

FIG. 5 is a diagram illustrating a user interface for submitting images,according to one exemplary embodiment of principles described herein.

FIG. 6 is a diagram of an illustrative use of a system for retrievinginteraction relationships between two objects, according to oneexemplary embodiment of principles described herein.

FIG. 7 is a diagram illustrating a graphical representation of an objectinteraction relationship, according to one exemplary embodiment ofprinciples described herein.

Throughout the drawings, identical reference numbers designate similar,but not necessarily identical, elements.

DETAILED DESCRIPTION

The present specification discloses a system and method forautomatically retrieving interaction information between two or moreobjects. More specifically, the present specification discloses usingimages of the two or more objects to retrieve the interactionrelationships between the objects. According to the principles describedherein, a user may submit images of two or more objects to a serverwhere the images will be converted into a set of parameters. The sets ofparameters extrapolated from the images may then be used to search adatabase or set of databases for interaction relationships between thedifferent sets of parameters.

As used in the present specification and appended claims, the term“image source” refers to a digital device that is capable of acquiring avisual, digital representation of an object. The image source mayinclude, but is not limited to, a desktop computer, a laptop computer, acellular phone, personal digital assistant, other mobile communicationdevice, a digital camera with computer or network connectivity, ascanner, and any device with digital image acquisition capabilities.

As will be appreciated by one skilled in the art, aspects of the presentinvention may be embodied as a system, method or computer programproduct. Accordingly, aspects of the present invention may take the formof an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present invention may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain, or store a programfor use by or in connection with an instruction execution system,apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations of the presentinvention may be written in an object oriented programming language suchas Java, Smalltalk, C++ or the like. However, the computer program codefor carrying out operations of the present invention may also be writtenin conventional procedural programming languages, such as the “C”programming language or similar programming languages. The program codemay execute entirely on the user's computer, partly on the user'scomputer, as a stand-alone software package, partly on the user'scomputer and partly on a remote computer or entirely on the remotecomputer or server. In the latter scenario, the remote computer may beconnected to the user's computer through a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

The present invention is described below with reference to flowchartillustrations and/or block diagrams of methods, apparatus (systems) andcomputer program products according to embodiments of the invention. Itwill be understood that each block of the flowchart illustrations and/orblock diagrams, and combinations of blocks in the flowchartillustrations and/or block diagrams, can be implemented by computerprogram instructions. These computer program instructions may beprovided to a processor of a general purpose computer, special purposecomputer, or other programmable data processing apparatus to produce amachine, such that the instructions, which execute via the processor ofthe computer or other programmable data processing apparatus, createmeans for implementing the functions/acts specified in the flowchartand/or block diagram block or blocks.

These computer program instructions may also be stored in acomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablememory produce an article of manufacture including instruction meanswhich implement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer orother programmable data processing apparatus to cause a series ofoperational steps to be performed on the computer or other programmableapparatus to produce a computer implemented process such that theinstructions which execute on the computer or other programmableapparatus provide steps for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

With reference now to FIG. 1, an illustrative system (100) forautomatically retrieving interaction information between objects isshown. The system (100) includes an image source (105), a server (110),and a database (115). The image source (105) is communicativelyconnected to the server (110). The connection may be an electricalconnection, a wireless connection, or any other connection that allowsthe image source (105) to communicate digital information to the server(110). The image source (105) may provide a plurality of digital images,or pictures, to the server (110). The images include two or more objectsto be compared.

After receiving the images, the server (110) converts the images into aset of parameters related to the objects in the images. The server (110)may utilize an image translation algorithm that is able to analyze theimages and determine the identity of any objects in each of the images.The algorithm may be able to recognize objects in the images based onshape, color, relative size, text in the image, and/or other imagerecognitions techniques. The server (110) may then use the datagenerated from the image recognition algorithm to create sets ofparameters that relate to the objects in the images. A data sourcehaving tagged data may be queried with the data from the images toobtain the parameters. In some embodiments, the images may include metadata tags used to obtain the parameters.

After obtaining the sets of parameters related to the objects in theimages, the server (110) searches a database (115) based on the sets ofparameters. The database (115) may be a general search database that isnot application specific and is accessed by the server (110) over aremote connection, or the database (115) may be a database specificallydesigned for the system (100) of the present specification. Each set ofparameters may include one or more descriptors for each of the objectsin the images. According to some embodiments, each image may contain oneobject, and the set of parameters generated from each image is relatedto the object in the particular image. According to other embodiments,an image may contain more than one object, and the set of parametersgenerated from that image may be related to all of the objects in theimage based on a common trait between the objects. The set of parametersmay include the name and traits of the object, as well as otherdescriptors, such as places where the object is commonly found or otherobjects that the object in the image is commonly associated with,including categories.

The database (115) may be searched for terms related to the sets ofparameters for determining interaction relationships between the objectsin the images. The database (115) may alternatively or additionally besearched for graphical representations of the object interactionrelationships. In such embodiments, the database (115) may bespecifically configured to include a large store of common pairs or setsof object interaction relationships. The interaction relationships maybe stored in textual descriptions or in graphical representations to bereturned to the server (110) as matches in the search.

The database (115) returns the data on the object interactionrelationships from the database search to the server (110). According toone embodiment, the server (110) may then organize the interactionrelationships for presenting to the user at the image source (105)according to commonality, complexity, or other method of organization.The method of organization may be set according to the preference of theuser and may be stored either at the image source (105) or at the server(110), depending on the application. The user may scroll through a listof interaction relationships provided by the server (110).

The server (110) may receive the interaction relationships from thedatabase (115) and then dynamically generate an illustrative interactiondiagram of the relationships for presentation to the user at the imagesource (105). If the database (115) returns images or diagrams that werealready stored in the database (115), the server (110) may simplyforward the diagrams directly to the image source (105). The diagramsshow the interaction relationship between each of the objects in theimages. The diagrams may be configured in any way that would suitablydemonstrate the interactions between the objects. The user may browsethe diagrams or other data returned to the image source (105) for aninteraction relationship as desired. The user may view all of theinteraction diagrams found in the search and may choose to print or savethe relationships for later viewing.

FIG. 2 shows a flowchart (200) illustration of a method forautomatically retrieving object interaction relationships. According tothe method, a user may record (205) images at an image source (105).This may include taking pictures of one or more of the physical objects.After recording the pictures, the images may then be forwarded (210) toa server (110) communicatively connected to the image source (105).

The server (110) analyzes (215) the images using image recognitionsoftware in order to determine the objects in the images. The server(110) is also able to obtain data for the objects identified in theimages after analyzing the images. The server (110) uses this data tocreate (220) sets of parameters, each set relating to an object in theimages.

The sets of parameters including the object data are then used to search(225) a database (115) for interaction relationships between theobjects. The interaction relationships may include instructions forusing the objects together, or the relationships may include adescription of how the objects are physically or otherwise connectedwith each other. The interaction relationships may include otherobjects, if needed, and may include the role a person may have in theinteraction between the objects. The server (110) takes the interactionrelationships returned by the database search and, if not already doneat the database, creates diagrams illustrating the interactionrelationships in order to provide (230) a visual illustration of therelationships, which can help understand the relationships. The diagramsare sent to the image source (105) and then displayed (235) for theuser.

FIG. 3 illustrates a plurality of different image acquiring devices(300) that may be used as or with an image source (105) according to theprinciples of the present specification. The image source (105) may beany device that is capable of acquiring digital images of the objects tobe analyzed, whether the image source (105) itself takes the picturesand converts them to digital images or whether the image sourcesreceives the images from another device and is merely used to connect tothe server. According to several embodiments, the image source may be apersonal digital assistant (commonly referred to as a “PDA”), a cellularphone, a desktop computer, a laptop, or any such device capable ofacquiring and displaying images of the objects and connecting to theserver through a communication connection (305). In some embodiments,the communication connection may be an Internet connection, such thatthe server (110) is a central server to be used by anyone with access tothe Internet. In other embodiments, the communication connection (305)may be a direct electrical connection, such that the server (110) is aprivate server to be used by a small group of users, such as a server ina business setting or the like. The connection (305) may also include awireless connection. In embodiments using mobile communication devicessuch as PDAs or cell phones, the connection (305) may be a wirelessconnection through a cell phone tower using a cellular phone network.

According to one embodiment, the image source (105) may be a computer.The computer may be connected to the server (110) via an Internetconnection. An image acquiring device (300) may be connected to thecomputer, so that the image acquiring device (300) takes the picturesthat are converted to digital images and then stored on the computer.The image acquiring device (300) may be a digital camera that capturesdigital images and is able to upload the images to the computer. Theimage acquiring device (300) may alternatively be a scanner, which mayconvert a photograph into a digital image for use on the computer.

In other embodiments, the image source (105) and the image acquiringdevice (300) may be the same device, or the image acquiring device (300)may be built into the image source (105). For example, as in theembodiment of FIG. 4, the image source (105) may be a cell phone havinga built-in digital camera. The digital camera may be used to takepictures of several objects, after which the images are automaticallystored in the cell phone memory or on a storage card. Because the cellphone is already connected to the server through the cell phone network,there is no need to transfer the digital images to another device.

According to some embodiments, either the image source (105) or theimage acquiring device (300) may allow the user to edit the images. Forexample, the user may have an image that includes several differentobjects, but the user wants the server (110) to analyze only one of theobjects in the image. The user may crop the image to include only thedesired object so that the server (110) doesn't analyze all of theobjects in the image. The user may also use other image editing toolsthat allow the user to sharpen the image or remove speckles from theimage so that the server (110) is more easily able to identify theobject in the image.

Referring back to FIG. 3, according to another embodiment, the imagesource (105) is a computer that acquires images containing the desiredobjects from a remote source, such as a website. The images may bepreviously existing images that are stored on a server not owned by theuser. For example, the user may acquire at least one of the imagesthrough an image search on the Internet. This may allow the user tosearch through many images related to a specific object to find the mostdesirable representation of the object. The images may becomputer-generated, rather than pictures of actual objects. The user maydownload the images to the computer and then upload the images to theserver. Alternatively, the image recognition program on the server maybe capable of retrieving images from the Internet if the user provides alink to each image. In such an instance, the server found using theInternet search may become the image source.

The embodiment of FIG. 4 also shows that the image source (105) mayacquire as many images as desired, each containing an object. The imagesource (105) may acquire “N” images (400) for “N” different objects,where each image is related to a separate object. The image source sendsa request to the server over the communication connection (305), and theserver (110) analyzes each image to determine the objects in each image.The analysis also provides a set of parameters for each image describingthe object in each image (400) and searches the database using “N” setsof parameters. The search returns interaction relationships between theobjects. The database may return interaction relationships between allof the objects together. The database may return interactionrelationships between one of the “N” objects and each of the otherobjects, or the database may return interaction relationships betweeneach of the individual objects with each of the other objects separatelyor in several groups. This may result in a number of interactionrelationships much larger than the “N” number of objects.

FIG. 5 illustrates a possible user interface (500) for submitting imagesfrom the image source to the server. The user interface (500) may be astand-alone program that may be separately downloaded to the imagesource. Alternatively, the user interface (500) may be a program that isincluded with the operating system, such as on a cell phone. The userinterface may allow the user to browse the file system on the imagesource for any images by selecting a browse button (505). The userinterface (500) may also display a number of images (510) stored locallyas a default setting. The user may change which images (510) are shownin the default setting. This may be useful if certain images are usedfrequently and the user desires to find interaction relationshipsbetween the frequently used images and other images. Additionally, theuser interface (500) may allow the user to compare the images (510) witheach other by viewing the images side-by-side and select the desiredimages using check boxes or some other method of marking the desiredimages. Selecting an image while browsing may cause an image to appearon the user interface. After selecting the desired images to transmit tothe server, with the use of a check box (520) in the present embodiment,the user may press a submit button (515) to transmit the images.

As previously mentioned, an image may include more than one object. Insuch an example, the user may select a single image for submission tothe server. When the user submits the image, the server receives theimage and analyzes the image. By using the image recognition software,the server may be able to recognize the multiple objects in the singleimage. The server may also generate a set of parameters for each of theobjects in the single image. These generated sets of parameters may thenbe used to search the database for interaction relationships between theobjects found in the single image.

FIG. 6 illustrates an embodiment of an application in which the systemof the present specification may be used. According to the presentembodiment, the automatic interaction relationship retrieval system maybe used in connection with automobiles and automobile parts. Forexample, a user may want information regarding a specific part of aparticular automobile. In one embodiment, the user may input a pictureof a license plate (600) connected to the particular automobile as oneof the images. Another image may be of a specific part of theautomobile, such as the engine coolant reservoir (605).

The server receives these images and analyzes them using the imageanalysis algorithm. The server recognizes the engine coolant reservoir(605) from the second image. The server may be able to determine themake and model of the automobile attached to the license plate (600)based on the license plate number extrapolated from the image andthrough a database of license plates and automobiles for each licenseplate. Alternatively, the user may submit a picture of the actualautomobile for the server. After determining the make and model of theautomobile, the server generates a set of parameters for each of theautomobile and the coolant reservoir. The set of parameters for theautomobile may include the make, model, year, and other usefuldescriptors of the automobile. The set of parameters for the reservoirmay include a simple descriptor or more, depending on the application.

After generating the sets of parameters related to the automobile andthe coolant reservoir, the sets of parameters are used to search thedatabase for interaction relationships between the automobile and thecoolant reservoir. One such relationship which may be returned by thesearch may include the type (610) of coolant that is recommended for theautomobile, which may be shown either with an image of a sample coolantor with text describing the coolant. The relationship may also include adescription or step-by-step instructions (615) of how to refill thecoolant in the automobile. Other aspects of the interaction relationshipmay include problems that may occur or precautions which may be taken inorder to prevent problems with respect to the reservoir.

After retrieving the interaction relationship from the database, theserver may then generate a diagram illustrating the relationships. Thediagram may be a graphic or several graphics that display therelationship in a manner that is easily read and interpreted by theuser. The diagram may include the images selected by the user, and mayalso include other images retrieved from the database. The diagram isthen sent to the image source for presentation to the user. The diagramallows the user to easily understand the interaction relationshipbetween the objects.

The system may also be used to find instructions on how to recognize orreplace warn or broken parts in an automobile. For example, the user maysubmit images of the automobile and a fuel pump for the automobile. Thedatabase may be searched for a description of how to recognize a brokenfuel pump and step-by-step instruction of how to replace the fuel pump.This may also extend to instructions for any system or apparatus inorder to allow many different kinds of do-it-yourself projects.

In another embodiment, the user submits images of a bus (705) and abicycle (710), according to the embodiment of FIG. 7, which shows asample diagram (700) that is returned from the server to the imagesource for presentation to the user. The diagram (700) demonstrates aninteraction relationship between the bicycle (710) and the bus (705),and additionally involves the interaction of a person (715). The personmay cause the bus to stop. Upon stopping, the bus deploys a bicycle rackwhere the bicycle may be positioned during transit. The person thenpicks up the bicycle and places the bicycle on the rack. The personboards the bus and the bus is then able to drive to continue on to theperson's destination. As demonstrated, the interaction relationship mayinclude objects that were not shown in any of the submitted images ifthe additional objects are necessary or even useful in the interactionrelationships between the objects included in the submitted images.

In some embodiments, the server may also return the sets of parametersused by the server to search the database for the interactionrelationships. This may allow the user to view the search terms used,which may be notify the user if the images need to be modified in someway and then sent back to the server for a new search. According to someembodiments, the user may be able to adjust the image recognitionsoftware or sets of parameters generated by the server in order toperform a more accurate search. The user may also be able to submitadditional search terms along with the picture, according to anotherembodiment.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a”, “an” and “the” are intended toinclude the plural focus as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, integers, steps, operations, elements,and/or components, but do not preclude the presence or addition of oneor more other features, integers, steps, operations, elements,components, and/or groups thereof.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription of the present invention has been presented for purposes ofillustration and description, but is not intended to be exhaustive orlimited to the invention in the disclosed. Many modifications andvariations will be apparent to those of ordinary skill in the artwithout departing from the scope and spirit of the invention. Theembodiment was chosen and described in order to best explain theprinciples of the invention and the practical application, and to enableothers of ordinary skill in the art to understand the invention forvarious embodiments with various modifications as are suited to theparticular use contemplated.

Having thus described the invention of the present application in detailand by reference to embodiments thereof, it will be apparent thatmodifications and variations are possible without departing from thescope of the invention defined in the appended claims.

1. A method for automatically retrieving interaction information betweenobjects, comprising: with a server, transforming a first image and asecond image submitted to said server from a source into first andsecond sets of parameters, respectively; searching a database for aninteraction relationship between said first and second images using saidfirst and second sets of parameters; and returning a representation ofsaid interaction relationship to said source.
 2. The method of claim 1,in which said first and second sets of parameters comprise objectsidentified in said first and second images.
 3. The method of claim 2,further comprising executing image recognition software with said serverto identify said objects.
 4. The method of claim 2, in which saidinteraction relationship between said first and second images comprisesa mechanical configuration of at least one said object identified insaid first image with relation to at least one said object identified insaid second image.
 5. The method of claim 2, in which at least oneparameter in said first and second sets of parameters comprises a traitshared by multiple said objects identified in one of said first andsecond images.
 6. The method of claim 1, in which said representation ofsaid interaction relationship comprises a graphical depiction of saidinteraction relationship.
 7. The method of claim 6, in which saidgraphical depiction of said interaction relationship comprises at leastone of: an image dynamically generated by said server and an imagestored by said database.
 8. The method of claim 1, in which saidrepresentation of said interaction relationship comprises returning atextual description of said interaction relationship.
 9. The method ofclaim 8, in which said textual description of said interactionrelationship comprises a step-by-step description of how a first objectin said first image interacts with a second object in said second image.10. The method of claim 1, further comprising: transforming a thirdimage submitted to said server from said source into a third set ofparameters; searching said database for a first interaction relationshipbetween said third image and said first image, and searching saiddatabase for a second interaction relationship between said third imageand said second image.
 11. The method of claim 10, further comprisingreturning a representation of said first interaction relationship and arepresentation of said second interaction relationship to said source.12. The method of claim 10, further comprising: combining said firstinteraction relationship with said second interaction relationship tofaun a third interaction relationship between all of said first image,said second image, and said third image; and returning a representationof said third interaction relationship to said source.
 13. The method ofclaim 1, further comprising returning said first and second sets ofparameters to said source.
 14. An object interaction relationshipprocurement system, comprising: a server configured to receive imagesfrom an image source, said server comprising an image-translationprogram for converting images into corresponding sets of parameters; anda database in communication with said server comprising a searchablestore of object interaction relationships; in which said server isconfigured to search said database for an object interactionrelationship corresponding to said parameters and return arepresentation of said object interaction relationship to said source.15. The system of claim 13, in which said representation of said objectinteraction relationship for said images comprises a graphical depictionof said object interaction relationship.
 16. The system of claim 15, inwhich said graphical depiction of said object interaction relationshipcomprises at least one of: a graphical depiction generated dynamicallyby said server and a graphical depiction stored in said database. 17.The system of claim 13, in which said returned representation of saidobject interaction relationship comprises a textual description of saidobject interaction relationship.
 18. The system of claim 17, in whichsaid textual description comprises a step-by-step description of howobjects in said plurality of images interact with each other.
 19. Acomputer program product for automatically retrieving interactioninformation between objects, the computer program product, comprising: acomputer readable storage medium having computer readable program codeembodied therewith, the computer readable program code comprising:computer readable program code configured to transform a first imageinto a first set of parameters and a second image into a second set ofparameters; computer readable program code configured to search adatabase for an interaction relationship between objects in said firstand second images; and computer readable program code configured toreturn a representation of said interaction relationship to a source ofsaid first image and said second image in an organized format.
 20. Thecomputer program product of claim 19, further comprising computerreadable program code configured to dynamically generate a graphicaldepiction of said interaction relationship.